Operator equality on entropy production in quantum Markovian master equations 
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An operator equality on the entropy production for general quantum Markovian master equations 
is derived without resorting quantum stochastic trajectory and priori quantum definition of entropy 
production. We find that, the equality can be still interpreted as a consequence of time-reversal 
asymmetry of the nonequilibrium processes of the systems. In contrast with the classical case, 
however, the first order expansion of the equality does not directly related to the mean entropy 
production, which arises from noncommute property of operators in quantum physics. 
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1 Introduction Irreversible processes can be seen almost everywhere in nature. Imaging that a process of an object falling 
■ into water starts from a static state and ends with some position and velocity after a finite time interval. However, if 
one wants to reverse the process by simply reversing the object's velocity from the ending position, the object never 
returns back its initial state after the same time interval. This phenomenon obviously arises from energy dissipation 
^ 1 as heat due to friction between the object and its reservoir. In modern thermodynamics, irreversible process is 
always related to nonnegative entropy production [HQ, or it is a manifestation of the second law of thermodynamics. 
Although the law has been rigidly established in macroscopic systems, in the past few decades, interest in the entropy 
production or dissipated work in small nonequilibrium systems has grown intensively due to the finding of various 
fluctuation theorems or relations |3-12|. These remarkable relations greatly deepen our understanding about the 



second law of thermodynamics and nonequilibrium physics of small systems. With the fluctuation relations clarified 
in the classical systems, recently, we may sec an trend of extending the relations into quantum systems T3T 24 1. 



In this work, we present an operator version for the entropy production equality in nonequilibrium systems 
that can be described by quantum Markovian master equations. Because Markovian description implies that 
the time change of external sources does not affect reservoirs and is very slowly in comparison with reservoir's 



relaxation time |25( , we are not intended to state that the equality obtained here holds even if the system is driven 



very far from equilibrium, e.g., like the entropy production equality derived by Deffer and Lutz [22[ using the 



sophisticated two-point energy measurement statistics 17, [20(. However, we think that the price is worthwhile 
paying, since we can derive an exact operator equality on the entropy production. Although there have existed 



various quantum fluctuation relations in the literature, to our knowledge, very few of them are in operator form [23ll24[ 



Time-reversal of system We concern about the irreversible process of an open quantum Markovian system L t during 
a time interval (0,T). The equation of motion for the system's density operator p(t) is then 

d t p(t) = L tP (t)=L^p(t) + L i r P (t), (1) 

where 

L™ p (t) = -i[H t ,p{t)], (2) 

Ht is free Hamiltonian of the system, and L 1 " rep resents a dissipative term due to the interaction of the system with 
a heat reservoir and it has a general form 2(j|- 29| 



Lrp(t) = WhPW}] + [vjp(t), vj}. (3) 

3 

Here we use the subscripts t to indicate their possible time-dependence except Vj and Vj for the simplicity in notation. 
We define an alternative quantum Markovian system L s as a time-reversal of the system ([T]), if its density operator 
p(s) satisfies a master equation of 

d s p(s) = L s p(s) = LTp(s) + LTp(s), (4) 

and 

Lf v A = -OL^iOAO- 1 }®- 1 , (5) 

l™ t a = ex^e^e-^e- 1 , (6) 
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FIG. 1: (a) An irreversible time process of the system L t . (b)The real time process of the time-reversal system L 3 with a 
specified initial condition 0p(T)O -1 . (c) The imaginary process constructed by the time reversed operator Op(t')B _1 , which 
is usually inconsistent with p(s) due to dissipation. 



where A denotes an arbitrary operator, t'=T—s is the backward time [30|, is time-reversal operator and we use 
a new time parameter s (0<s<T) for the time-reversal system. Specifically, if the system is consistent with its 
time-reversal, we call such a kind of system to be symmetric or invariable under time-reversal. These definitions are 
in fact a simple quantum extension of those in classical Markovian process 31, 32| . 



Operator R{t' , T) If the dissipation term L\ rl ' vanishes, and the Hamiltonian H t is even under the time reversal, namely, 
H s =OH t > < d~ 1 , one may easily prove that a time-reversed operator, 0p(f')0 -1 , is the solution of the time-reversal 
system (j4]) with a specified initial condition Qp(T)Q^ 1 . We call such kind of solution to be time-reversible. In addition, 
if the system is symmetric under time- reversal and is at thermal equilibrium state po, the state is also time- reversible 
and invariable specifically, i.e., 0pQ<3~ 1 =pa. Generally speaking, as open quantum system has a dissipative term, if 
it is perturbed by time-dependent sources, and/or is relaxing to its equilibrium state, the solution p(t) is no longer 
reversible. This observation could be simply quantified if we introduce an operator R(t',T) satisfying a relationship 
of 



p(s) = eR(t' 1 T)p(t')e-\ 



(7) 



and R(T,T)=1. Obviously, if the solution p(t) was reversible, R(t',T) would equal the identity operator during the 
whole time interval; otherwise it would not. Fig. Q] schematically explains the reason which we define the operator 
R(t',T). 

Substituting ([7]) into Eq. (p}, we can obtain an equation of motion for i?(T, t') with respect to the backward time 
t' given by 



d t ,R(t',T) = -L* t ,R(t',T)-R(t',T)[d t ,p(t')-L t ,p(t')]p(t') 1 

-{J2[R(t',T)V jP (t'),Vj] - [R(t, T)p(t')Vj , VjWp^')" 1 



(8) 



-L* t ,R{t',T)-O t ,R(t',T), 
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where the adjoint generator is L^, A=i[H t > , A] + (1/2) Y^jWj j AVj'+^j [A Vj] an d L^,1=0 particularly. In the remaining 
part, we use the superscript (■••)* to denote an adjoint super-operator with respect to the trace unless otherwise 
stated. Notice that this is a terminal condition problem instead of conventional initial condition problem. If we regard 
the term having the super-operator 0' t in Eq. ((5J) as a perturbation, which is rational because we concern about the 



deviation of R(t', T) with respect to 1, we can obtain a formal solution for R(t' , R) using the Dyson series [23J, |24 
R{t',T) = [G*(t',T) + J2 / dt x --- dt n IjG*(fi_i,ti)O tt G*(t„ > r)]i2(r,r) 

n=l*' t ' Jtn-1 i=1 



(9) 



where G*(t\ T)=7+ ex p[ L rfrL*] is the adjoint propagator of the system, and 7+ denotes the antichronological 
time-ordering operator |29| . 

operator equality on the entropy production. Although we have the formal expression for R(t',T), it is not satisfied 
because the perturbation in Eq. ([9]) involves p(t'), which makes its physical explanation ambiguous. In order to 
proceed further, in this work we restrict the s yste m to those satisfying instant detailed balance condition with respect 
their instant thermal equilibrium state po (t) [331 [3^ | : 

L? v Po(t) = 0, (10) 
L^Apoit) = L™[A]p (t). (11) 

These conditions mean that the system always relaxes to its thermal equilibrium state po(t), if the external source is 
fixed at the value with time point t [35j. This limitation seems not very strict from physical point of view. Under this 
circumstance, we may define an auxiliary operator Rg(t',T) as follows: 

R(t',T)p(t')=R Q (t',T)p (t'). (12) 

One can prove that the equation of motion for Ro(t' , T) is analogous to Eq. ([8]) except that the previous perturbation 
term is now replaced with 

- W t >R (t',T) = ~R (t\T)d t ,p {t')p (t')-\ (13) 

and the terminal condition of Ro(t',T) is p(T)pQ 1 (T). The reader is reminded that the new defined Wt is a super- 
operator, thought its action on an operator is a simple multiplication from the operator's right-hand side. 

As we mentioned previously, a deviation of R(t' , T) with respect to 1 indicates the time-irreversibility of the solution 
p(t). Hence, selecting t'=0, regarding the logarithms of the all density operators as "small" operator and using the 
relation (fl~3|) and the Dyson series for i?o(0,T), we can expand R(0,T) around 1 until the first order: 

R(0,T) = l + Q- 1 In p(T)Q- In p(0) + ■ ■ ■ (14) 

= l + G*(0,T)lnp{T)-G*(0,T)lnp o {T)+ f drG* (0, r)d T In Po (t) + In p (0) - In p(0) + •• • (15) 

The first equation arises from the definition ([7]), and in the latter equation we have used a simple property of 
G*(0, T)l = 1. We must point out explicitly that the first order expansion has also been applied to the super-operator 
W r . Notice that the above equation also holds if the initial time is replaced with arbitrary time point t' (< T). 

We find that an equal of Eqs. (fl"4"]) and p5[) provides us an microscopic expression for the second law of thermo- 
dynamics. To sec it, Multiplying them with p(0) and taking the trace, we have 



(ln i o(0))o-(e- 1 lnp(r)e)o 



= [-(lnp(r)) T + (lnp(0))o] + [(lnpo(T)}T-(lnpo(0))o- / dr(d T \n p (r)) T ] (16) 



T 





where (A) r =Tr[Ap(r)], we have used properties of Tr[G*(i', T)(A)B] = Tr[AG(T, t')(B)\ and G(r, 0)/>(0)=p(r). Here 
G(T, t') is the system's propagator and equals 71 exp[J., drL T ] , and 71 is the chronological time-ordering operator [2^] . 
We see that, on the right-hand side of Eq. (fT6|) . the terms in the first square bracket is the change of von Neumannn 
entropy of the system, S( P (t))=— (lnp(r)) r , while the terms in second square bracket is the mean heat transfer from 
the system to the heat reservoir. The latter is consequence of the first law of thermodynamics [5^], which becomes 
obvious if the quantum master equation is obtained under the weak coupling limits and the equilibrium state po(t) 
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has a canonical ensemble [26, 3(1 37 1. According to the principles of phenomenological thermodynamics the whole 



expression on the right-hand side is no other than the mean entropy production of the irreversible quantum process and 
it is always assumed to be nonnegative. Deffer and Lutz obtained the same expression by the principle directly [22j ■ 
Compared with their argument, here two interesting features are revealed by the terms on the left-hand side of Eq. (|16l) . 
First, because of the equal between two sides, we have a new form for the mean entropy production, which is based 
on the initial and terminal density operators of the original and time-reversal systems, respectively. In particular, 
if the initial state is time- reversal invariable, e.g., the system initially being a thermal equilibrium, the expression 
of left-hand side is just a quantum relative entropy, S(p(0)\\p(T)) [38|. Under this circumstance, the nonnegative 
property of the mean entropy production has a rigors mathematical foundation rather than phenomenological reason. 
Second, if we concerned about a relaxation process of a time-reversal symmetric system from nonequilibrium initial 
state p(0) to the thermal equilibrium po after time T without any external perturbation (35| . the expression on the 
left-hand side would become S(p(0)\\po). The reason is that the time-reversal system starts from the equilibrium 
initial state po that is also the terminal state of the relaxation process. Therefor, p(T) would equal po. In this case, 
the equal between two sides of Eq. (fT6|) becomes trivial. 

Now we present an operator equality on the entropy production: 

r T 

1 = (p{T) Po (T)- l T-eiq>[ drdrp^p^^p^p- 1 ^)) (17) 







Proof: 

1 = Tr[Q- 1 p(T)Q]=Tr[R (0,T)p (0)] 



Tr{[G*(0,T) + ^ / dty- / dt„I]G*(t,_ 1 ,t,)W i ,G*(( n ,T)][p(T)p - 1 (T)]p (0)} 
n=1 Jt< Jt n -i i=1 

Tr[p(T)p Q 1 (T)G(T,0)p o (0)} + f dt 1 Tiip(T)p^(T)G(T 7 t 1 )d tl p o (t 1 )po 1 (t 1 )G(t 1 ,0)p o (0)} 



(pWpoW^poWp- 1 ®) + / dt 1 (p(T)p (T)- l d tl p (t 1 )po 1 (h)p (Q)p- 1 (Q)) + ■■■ 



The transformation from the third line to the forth line is based on the definition of multi-time correlation for 
operators in quantum master equations H, 39|. We must emphasize that, expanding the time-ordered exponential 



term in the operator equality to the first order does not simply lead into the mean entropy production equation (|16p , 
since d T po{T)pQ 1 (t) usually does not equal <9 r In /9o( T )i which is unique only in quantum physics. 



Quantum Jarzynski equality Chetrite and Mallick have derived an operator Jarzynski equality using a modified dy- 
namics for the accompanying density matrix [23[. Here we can give an alternative derivation using the same sprint 
deriving Eqs. (|17|) . Following the conventions of proving Jarzynski equality 0, ii, we assume that the system 
has instant equilibrium solutions po(t) satisfying the detailed balance condition, and the system is initially in equi- 
librium of po(0). Analogous to previous case, we are still interested in comparing two processes from the original 
system and the time-reversal system using ([7]), but here the initial density operator of the latter process is replaced 
with p(0)=po(T). Therefor, the terminal condition R(T,T) becomes po(T)p~ 1 (T) instead of previous 1. Because of 
the instant detailed balance condition, we may introduce an auxiliary Ro(t',T) as (|12j) again and doing the same 
calculation to obtain the operator Jarzynski equality 

l = (T-eX P [/ dTd T po(T)p^(T)])o (18) 

Jo 

Here the subscript is to indicate that the equality holds only for equilibrium initial condition. Obviously the 
operator equalities (|17j) and (|18j) are not the same unless both the initial and terminal states of the nonequilibrium 
process are thermal equilibriums. 



Discussion and conclusion By investigating the difference between the density operators of quantum Markovian 
master equation and its time-reversal, in this work we present an operator equality on the entropy production. 
Our discussion is based on there key assumptions. The first two assumptions are a description of perturbed 
quantum system using the Markovian master equation and the system satisfying instant detailed balance condition, 
respectively Although the two assumptions seem to limit the validity of the operator equality in very far from 
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equilibrium regime, we should emphasize that analogous assumptions in fact have been implied in derivation of 
the various fluctuation relations in classical Markovian systems. The last assumption is the existence of In /?(£), 
or equivalently the system's density operator to be invertible. So far, we do not find a satisfying mathematical 
or physical approach to justify it. Hence, we have to leave it for future study. Finally, we may point out that an 
extension of present theory to the classical Markovian processes is very straightforward. 



We appreciate Prof. Chetrite for sending their inspiring work [231 ] to us. This work was supported by the National 
Science Foundation of China under Grant No. 11174025. 
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